Root-mean-square error (RMSE) or mean absolute error (MAE): when to use them or not

نویسندگان

چکیده

Abstract. The root-mean-squared error (RMSE) and mean absolute (MAE) are widely used metrics for evaluating models. Yet, there remains enduring confusion over their use, such that a standard practice is to present both, leaving it the reader decide which more relevant. In recent reprise 200-year debate Willmott Matsuura (2005) Chai Draxler (2014) give arguments favoring one metric or other. However, this comparison can false dichotomy. Neither inherently better: RMSE optimal normal (Gaussian) errors, MAE Laplacian errors. When errors deviate from these distributions, other superior.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature

Both the root mean square error (RMSE) and the mean absolute error (MAE) are regularly employed in model evaluation studies. Willmott and Matsuura (2005) have suggested that the RMSE is not a good indicator of average model performance and might be a misleading indicator of average error, and thus the MAE would be a better metric for that purpose. While some concerns over using RMSE raised by W...

متن کامل

Root Mean Squared Error

• Predictive Accuracy Measures. These measures evaluate how close the recommender system came to predicting actual rating/utility values. • Classification Accuracy Measures. These measures evaluate the frequency with which a recommender system makes correct/incorrect decisions regarding items. • Rank Accuracy Measures. These measures evaluate the correctness of the ordering of items performed b...

متن کامل

Determination of Exponential Smoothing Constant to Minimize Mean Square Error and Mean Absolute Deviation

Exponential smoothing technique is one of the most important quantitative techniques in forecasting. The accuracy of forecasting of this technique depends on exponential smoothing constant. Choosing an appropriate value of exponential smoothing constant is very crucial to minimize the error in forecasting. This paper addresses the selection of optimal value of exponential smoothing constant to ...

متن کامل

Colloquium: Quantum root-mean-square error and measurement uncertainty relations

Recent years have witnessed a controversy over Heisenberg’s famous error-disturbance relation. Here we resolve the conflict by way of an analysis of the possible conceptualizations of measurement error and disturbance in quantum mechanics. We discuss two approaches to adapting the classic notion of root-mean-square error to quantum measurements. One is based on the concept of noise operator; it...

متن کامل

Optimum thresholding using mean and conditional mean square error

We consider a univariate semimartingale model for (the logarithm of) an asset price, containing jumps having possibly infinite activity (IA). The nonparametric threshold estimator ˆ IV n of the integrated variance IV := ∫ T 0 σ sds proposed in [6] is constructed using observations on a discrete time grid, and precisely it sums up the squared increments of the process when they are under a thres...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Geoscientific Model Development

سال: 2022

ISSN: ['1991-9603', '1991-959X']

DOI: https://doi.org/10.5194/gmd-15-5481-2022